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LOW POWER CACHE ARCHITECTURE 



BACKGROUND 

The present invention relates to a cache architecture that contributes to reduced power 
consumption of integrated circuits. More particularly, the cache architecture permits units within 
5 the cache to be disabled on a microinstruction-by-microinstruction basis. 

Issues of power consumption have become increasingly important for the design of 
integrated circuits. The power consumption of integrated circuits, particularly that of processors, 
has increased over the years with the historical increase clock speeds. Modern processors now 
consume so much power that the heat generated by the processors has become destructive. 
10 The increase in power consumption also contributes to reduced battery life in mobile computing 
^ applications. 

H Power management techniques are commonplace in the modern computer. Users of 

]k domestic personal computers recognize that computer monitors, disk drives and the like are 
H disabled when not in use. However, such techniques are not able to keep pace with the ever 
«%15 increasing power demands made by newer generations of integrated circuits. Accordingly, 
® there remains a need in the art for an integrated circuit architecture that contributes to reduced 

fn power consumption of the integrated circuit. 
fU 

ttl An internal cache may be perhaps the largest functional unit within a processor. In the 

^2: Pentium Pro® processor, commercially available from Intel Corporation, an L2 cache may have 
20 a capacity to store 2 MB of data and may occupy approximately 60% of the processor's area 
when manufactured as an integrated circuit. If a power control technique could be applied to a 
processor's cache, it could achieve considerable power control savings for the chip overall. 

It is known to disable (e.g. power down) a processor cache when it is not in use in order 
to save power. Such a technique, however, disables the cache entirely and can be used only 
25 when the cache has no operation to perform. As is known, a cache may have a high utilization 
rate. Accordingly, the known power conservation techniques for caches do not achieve 
significant reductions in power consumption. 

No known power control scheme for a processor cache permits the cache to conserve 
power when in operation. 
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BRIEF DESCRIPTION OF THE DRAWINGS 



FIG. 1 is a block diagram of a processor cache according to an embodiment of the 
present invention. 

FIG. 2 is a state diagram illustrating operation of the cache manager in accordance with 
5 an embodiment of the present invention. 

FIG. 3 is a state diagram illustrating operation of the cache manager in accordance with 
an embodiment of the present invention. 

FIG. 4 is a state diagram illustrating response to a read request in accordance with an 
embodiment of the present invention. 

10 FIG. 5 is a block diagram illustrating cache organization according to conventional 

^ techniques. 

'" 5 K 

FIG. 6 is a block diagram illustrating cache organization according to an embodiment of 
^ the present invention. 

S PS 

O DETAILED DESCRIPTION 

^ 15 Embodiments of the present invention provide a processor cache in which cache circuits 

f|| are mapped into one or more logical modules. Each module may be powered down 
]J? independently of other modules. Caches typically operate according to microinstructions. For 
Q many microinstructions, certain modules will not participate in the cache operations. Power 
savings may be achieved by powering down modules on a microinstruction-by-microinstruction 
20 basis. 

FIG. 1 is a block diagram of a processor cache according to an embodiment of the 
present invention. According to the embodiment, the cache 100 may be populated into a 
plurality of cache entries 110. The embodiment of FIG. 1 illustrates the cache entries 110 
organized into sets and ways. As shown in FIG. 1 , way 0 may include a predetermined number 
25 N of cache entries. Each cache entry 110 may be organized into a tag field 120, a data field 
130 and a stage field (labeled "S"). Data to be stored in the cache 100 may be stored in the 
data fields 130 of the cache entries 110. Partial address information identifying a source of the 
data stored in a data field 130 may be stored in the tag field 120. Cache coherency state 
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information may be stored in the state field S. For simplicity's sake, the architecture of a single 
way (way 0) is illustrated in FIG. 1 ; the architecture of way 0 may extend to the other ways 1 , 2, 
etc. In practice a cache may include fewer or more ways than the four ways shown in FIG. 1 . 

The cache 100 may include an address decoder 140. The address decoder 140 may 
5 have an input for a portion of address data (labeled ADDR set ). The address decoder 140 may 
have a plurality of outputs, one connected to each of the N cache entries 110 in each of the 
ways. The decoder 140, therefore, may define "sets" within the cache 110 (referenced with 
respect to output lines from the decoder 140). The decoder output labeled "setO," for example, 
may be connected to one cache entry 1 1 0 from each of the ways in the cache 1 00. Similarly, all 
10 other output lines from the decoder 140 may be connected to one cache entry 110 from each 
ways. Some processors may provide separate decoders for the tag fields 1 20 and cache fields 
130 of a single cache entry 110 (embodiment not shown). In response to an address signal 
o ADDR S et, the decoder 140 may enable W cache entries 1 1 0, where W represents the number of 
^ ways in the cache 1 00. 
£- 

1 5 Each way may include a comparator 1 50 having a first input coupled to the tag fields 1 20 

]H of the cache entries 110 within the respective way. The comparator 150 also may have a 
q second input coupled to a second portion of an address input, labeled ADDR tag . When in use, 
f stored tag information from one of the cache entries 110 will be output to the comparator 150 in 

response to an output from the decoder 140. The comparator 150 may generate an output 
[U 20 which is enabled when the stored tag data matches the ADDR tag input. The output from a 
pi comparator 150 may control a transmission gate 135 on the output from data fields 130 to 
Q permit data read from the data fields 1 30 to propagate from the way in response to a tag match. 

The cache 100 also may include a victim allocation unit 160, populated by a plurality of 
eviction control registers (LRUs) 170. The victim allocation unit 160 may have an LRU 170 for 
25 each set in the cache 100. When new data is to be written to a particular set (say, setO) in the 
cache 100 and all sets contain valid data, data must be evicted from one of the ways before the 
new data may be stored. For each set, the LRUs 170 identify one of the ways (called, a "victim 
way") as the next data to be evicted. Typically, eviction occurs according to a least-recently- 
used, round-robin or other conventional basis. 

30 A cache 100 may include a cache manager 180, which, typically, is a state machine. 

The cache manager 180 may receive data requests from other processor components (not 
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shown) relating to the reading or writing of data to/from the cache 100. The cache manager 180 
may operate in accordance with several micro-operations (commonly, "UOPs") to accomplish 
this function. Known UOPs include: 

• Evict, causing data to be evicted from a cache entry 1 1 0; 

5 • Read Line, LRU Update ("RLU"), causing data to be read from an addressed 

cache entry and updating the LRU register 170 based on new use; 

• Tag Inquiry ("Tl"), reading tag data 120 from addressed cache entries 110 
for comparison with input ADDR tag data; 

• Tag Read/Data Read ("TRR"), reading the tag field 120 and data field 130 of 
1 0 addressed cache entries 110; 

• Tag Write ("TW"), writing data to the tag field 1 20; 

• Tag Write/Data Read ("TWR"), reading data 130 from a cache entry 1 10 and 
writing data to the tag field 120 thereof; and 

□ • Tag Write/Data Write ("TWW"), writing data to the tag field 1 20 and data field 

0 15 1 30 of an addressed cache entry 1 1 0. 

g The cache manager 180 typically manages the operation of the cache 100 to fulfill the data 

5 requests via control paths to each field 120, 130, S of each cache entry 110 (not shown in FIG. 

II 1 for simplicity). 

The cache 100 operates in synchronism with a system clock. Individual components 
ij 20 within the cache (the cache entries 100, decoder 140, comparator 150, LRUs 170) operate in 
accordance with clock signals derived from the system clock. A clock distribution network 200 
is provided within the processor to distribute the clock signals throughout the cache. In this 
regard, the operation and structure of a set-associative cache is well-known. 

According to an embodiment, the cache manager 180 may interact with the clock 
25 distribution network 200 to selectively enable or disable logical modules in response to UOPs. 
For example, the clock distribution network 200 may be coupled to each tag field 120, data field 
130 and state fields S of each of the ways by a respective clock line C. In an embodiment, 
transmission gates G may be provided on the clock lines C. The transmission gates G may be 
controlled by the cache manager 180 to selectively enable or disable the clock lines. Clock 
30 lines to cache entries 1 10 in a first way (say, way 0) may be controlled independently of clock 
lines to cache entries 1 10 in a second way (way 1). A clock line C of the victim allocation unit 
160 similarly may be provided with a transmission gate G under control of the cache manager 
180. 



350961_1.DOC 



Page 4 of 1 9 



PI 0608 



Table 1 below identifies the settings of each module for each UOP: 



Microinstructions (UOPs) 


Tag 120 


Data 130 


State S 


LRU 170 


iMUmuer ui 
Ways 


Fvint 

1— V IUL 


On 


On 


On 


Off 


One 


Read Line, LRU Update ("RLU") 


On 


On 


On 


On 


All 


Tag Inquiry ("Tl") 


On 


Off 


On 


Off 


All 


Tag Read/ Data Read ("TRR") 


On 


On 


On 


Off 


One 


Tag Write ("TW") 


On 


Off 


On 


Off 


One 


Tag Write/Data Read ("TWR") 


Off 


On 


On 


"" Off 


One 


Tag Write/Data Write ("TWW") 


On 


On 


On 


Off 


One 



Table 1 

By disabling cache components such as ways, tag fields 120, data fields 130, state fields S and 
LRUs 170 on a UOP-by-UOP basis, the cache architecture 100 achieves considerable power 
5 conservation over known alternatives. 

FIG. 2 is a state diagram illustrating operation of the cache manager 180 (FIG. 1) in 
accordance with an embodiment. The cache manager 180 may begin operation in an idle state 
300 and transition out of the idle state 300 in response to data request. 

When the data request is a read operation, the cache manager 180 may generate an 
10 RLU UOP 310. The RLU UOP 310 may energize the tag fields 120, data fields 130 and state 
fields S of all ways in the cache 100 (FIG. 1) as well as the LRU 170 in the set identified by the 
ADDR S et so that data may be read from them. As explained, tag data 120 is read from each way 
and compared with the ADDR tag information. A cache hit/miss decision may be made from the 
comparison. A cache "hit" may be signaled when one of the comparators 150 indicates a match 
15 and state data S indicates the presence of valid data in the data field 130; it means that the 
requested data is located within the cache 100. Otherwise, the request is said to "miss" the 
cache. 

The LRU 170 identifies the next way that will be selected as a victim. If a cache miss 
occurs, new data eventually may be stored in the cache 100. The cache manager 180 may 
20 determine from the state information of the victim way whether the victim is dirty or not. "Dirty" 
data is data that has been modified; it may be the most current copy of the data in the system. 
Dirty data is protected against destruction. If the victim data is dirty, the cache manager 180 
may generate an Evict UOP 320 to evict the dirty data from the cache 100 without destroying it. 
During processing of the Evict UOP 320, only a victim way (say, way 0) may be enabled. All 
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other ways and the victim allocation unit 160 may be powered down. Thereafter, or if the victim 
data was not dirty, the cache manager 1 80 may return to the idle state 300. 

When the data request is a data replacement instruction, the cache manager 180 may 
issue a TWW UOP 330. The TWW UOP 330 may cause the tag field 120, the data field 130 
5 and the state field S of a single way, called the "target way," to be energized so that new data 
can be written to it. All other ways and the victim allocation unit may be powered down during 
the TWW UOP 330. The cache manager 180 may identify the target way from the data 
replacement instruction itself. Thereafter, the cache manager 180 may return to the idle state 
300. 

10 When the data request is a write instruction issued pursuant to a data eviction from a 

higher-level cache (not shown), the cache manager 180 may issue a Tl UOP 340. The Tl UOP 
340 may energize the tag fields 120 and state fields S of all ways in the cache 100. The data 

2 fields 130 throughout the cache 100 and the victim allocation unit 160 may be powered down 
:! during the Tl UOP 340. The cache manager 180 may determine a hit or miss based upon 
J 15 outputs from the way comparators 150 and the state fields. If a hit occurs, the cache manager 
H 180 may issue a TWW UOP 330, causing new data to be written to the tag field 120 and data 

3 field 130 of the cache entry 110 that cause the hit. All other ways and the victim allocation unit 
: f may be powered down during the TWW UOP 330. Thereafter, the cache manager 180 may 
p| return to the idle state 300. 

i til 

fU 

W 20 When the data request is a cache writeback invalidate instruction, the cache manager 

Sf 180 may issue a TRR UOP 350. The TRR UOP 350 may cause data from the tag field 120, the 
data field 130 and the state field S of an addressed cache entry 110 in a victim way to be 
energized. All other ways may be powered down during processing of the TRR UOP 350. The 
cache manager 1 80 may identify the victim way from the data request itself. From the state field 
25 S, the cache manager 180 may determine if the victim cache entry 1 10 is valid or non-valid. If 
the victim cache entry 110 is valid, the cache manager 180 may generate a TW UOP 360 
causing new state data, designating an invalid state, and possibly tag information, to be written 
to the cache entry 110. All other ways and the victim allocation unit 160 may be powered down 
during processing of the TW UOP 360. Thereafter, or if the victim cache entry 110 was invalid, 
30 the cache manager 1 80 may return to the idle state 300. 
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If the cache 100 (FIG. 1) were positioned within a cache hierarchy above other higher- 
level cache, a data request that indicates a write of data pursuant to a Read For Ownership 
("RFO") request need not cause data to be written in the cache 100. Typically, the data is being 
written to other higher-level caches (not shown) so the data can be modified. Eventually, the 
5 data may be written to the cache 100 pursuant to an eviction from the higher-level cache. 
Accordingly, in an embodiment, when the data request is a write of data pursuant to an RFO, 
the cache manager 180 may generate a TW UOP 360, causing a write of tag and state 
information in the tag field 120 and state field S of a cache entry 1 10 in a single way. All other 
ways and the victim allocation unit 160 may be powered down during processing of the TW 
1 0 UOP 360. Thereafter, the cache manager 180 may return to the idle state 300. 

If the data request is a cache invalidate command, the cache manager 180 also may 
generate a TW UOP 360. The TW UOP 360 may cause a write of tag and state information in 
q the tag field 1 20 and state field S of a cache entry 1 1 0 in a single way. The cache manager 1 80 
© may determine the target way from the cache invalidate command itself. All other ways and the 
jg 15 victim allocation unit 160 may be powered down during processing of the TW UOP 360. 
jfif Thereafter, the cache manager 180 may return to the idle state 300. 

q If the data request is a snoop probe, the cache manager 180 may generate a Tl UOP 

f 370. The Tl UOP 370 may cause data to be read from the tag fields 1 20 and state fields S from 

rp addressed cache entries 1 10 in all ways of the cache 100. The data fields 130 throughout the 
[W 20 cache 100 and the victim allocation unit 160 may be powered down during the Tl UOP 370. 
PJ Following the Tl UOP 370, if a way comparator 150 indicates a tag match, the cache manager 
CI may generate a TW UOP 380 if the state information from the matching cache entry 110 
indicate that the data were held in exclusive state or if the snoop probe were not a Go-to-Shared 
snoop. The TW UOP 380 may update the data held in the state field S of the matching way. All 
25 other ways and the victim allocation unit 160 may be powered down during processing of the 
TW UOP 380. Thereafter, the cache manager 180 may return to the idle state 300. Following 
the Tl UOP 370, if the state information from the matching cache entry 110 indicates that the 
data is invalid or modified, the cache manager 1 80 may return to the idle state 300. 

If the data request is a snoop confirm command and no data is to be transferred via an 
30 implicit writeback, the cache manager 180 may generate a TW UOP 380. The TW UOP 380 
may cause data to be written to the state field S from an addressed cache entry 1 10 in a single 
way of the cache 100. All other ways and the victim allocation unit 160 may be powered down 
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during processing of the TW UOP 380. Thereafter, the cache manager 180 may return to the 
idle state 300. 

If the data request is a snoop confirm command and data is to be transferred via an 
implicit writeback, the cache manager 180 may generate a TWR UOP 390. The TWR UOP 390 
5 may cause data to be read from a data field 130 and new state data to be written to the state 
field S in a single way of the cache 100. All other ways and the victim allocation unit 160 may 
be powered down during processing of the TWR UOP 390. Thereafter, the cache manager 180 
may return to the idle state 300. 

The foregoing description illustrates operation of a cache 100 that integrates power 
10 control techniques of the present embodiments with UOPs of known caches. It is believed that 
the foregoing embodiments achieve greater power conservation in a processor system than was 
available by other known power control techniques. 

£3 

Cl Additional power conservation may be achieved by the cache architecture 100 by 

HP enhancing the UOPs employed by such a cache. Accordingly, the following description 
Ci 15 presents embodiments of the present invention that redefine cache UOPs and their uses to 
in improve the power control techniques even further. 

According to an embodiment, the cache manager 180 may interact with the clock 
fU distribution network 200 to selectively enable or disable logical modules in response to UOPs. 
ffi Table 2 below identifies the settings of each module for each UOP: 



Microinstructions (UOPs) 


Tag 120 


Data 130 


State S 


LRU 170 


Number Of 
Ways 


Data Write ("DW") 


Off 


On 


On 


Off 


One 


Evict 


On 


On 


On 


Off 


One 


Read Line, LRU Update ("RLU") 


On 


On 


On 


On 


All 


Tag Inquiry ("Tl") 


On 


Off 


On 


Off 


All 


fag Read/ Data Read ("TRR") 


On 


On 


On 


Off 


One 


Tag Write ("TW") 


On 


Off 


On 


' Off 


One 


fag Invalidate ("TWI") 


Off 


Off 


On 


" Off " 


One 


Tag Write/Data Read ('TWR") 


Off 


On 


On 


Off 


One 


Tag Write/Data Write ("TWW") 


On 


On 


On 


Off 


One 



20 Table 2 



350961.1 doc Page 8 of 1 9 pi 0608 



FIG. 3 is a state diagram illustrating use of the UOPs, according to an embodiment of 
the present invention. According to this embodiment, the cache manager 180 may begin 
operation in an idle state 400 and transition out of the idle state 400 in response to a data 
request. 

5 When the data request is a read operation, the cache manager 180 may generate an 

RLU UOP 410. The RLU UOP 410 may energize the tag fields 120, data fields 130 and state 
fields S of all ways in the cache 100 (FIG. 1) as well as the LRU 170 in the set identified by the 
ADDR S et so that data may be read from them. A cache hit/miss decision may be made from tag 
comparisons in each of the ways. If a cache miss occurs, the cache manager 180 may 
10 determine from the state information of a victim way (identified by the LRU 170). If the victim 
way is dirty, the cache manager 1 80 may generate an Evict UOP 420 to evict the dirty data from 
the cache 100. The Evict UOP 420 may cause only one of the ways to be energized; all other 
ri ways and the victim allocation unit 1 60 may be powered down. Thereafter, or if the victim data 
i m was not dirty, the cache manager 1 80 may return to the idle state 400. 

alas. 

Jr 15 When the data request is a data replacement instruction, the cache manager 180 may 

H issue a TWW UOP 430. The TWW UOP 430 may cause the tag field 120, the data field 130 

I ft 

H and the state field S of a target way to be energized so that new data can be written to it. All 

f other ways and the victim allocation unit may be powered down during the TWW UOP 330. The 

ru cache manager 180 may identify the target way from the data replacement instruction itself. 

U 20 Thereafter, the cache manager 180 may return to the idle state 400. 

When the data request is a write instruction issued pursuant to a data eviction from a 
higher-level cache (not shown), the cache manager 180 may issue a Tl UOP 440. The Tl UOP 
440 may energize the tag fields 120 and state fields S of all ways in the cache 100. The data 
fields 130 throughout the cache 100 and the victim allocation unit 160 may be powered down 
25 during the Tl UOP 340. The cache manager 180 may determine a hit or miss based upon 
outputs from the way comparators 150 and the state fields. If a hit occurs, the cache manager 
180 may issue a DW UOP 430, causing new data to be written to the data field 130 and state 
field S of the cache entry 110 that caused the hit. The tag field 120 need not be energized. 
Further, all other ways and the victim allocation unit 160 may be powered down. Thereafter, the 
30 cache manager 1 80 may return to the idle state 400. 



3*3 ; 
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When the data request is a cache writeback invalidate instruction, the cache manager 
180 may issue a TRR UOP 450. The TRR UOP 450 may cause data from the tag field 120, the 
data field 130 and the state field S of an addressed cache entry 110 in a victim way to be 
energized. All other ways may be powered down during processing of the TRR UOP 450. The 
5 cache manager 180 may identify a victim way from the data request itself. From the state field 
S, the cache manager 180 may determine if the victim cache entry 110 is valid or non-valid. If 
the victim cache entry 110 is valid, the cache manager 180 may generate a TWI UOP 460 
causing new state information, designating an invalid state, to be written to the cache entry 110. 
The tag field 120 and the data field 1 30 in the victim way need not be energized. All other ways 
10 and the victim allocation unit 160 may be powered down during the TWI UOP 460. Thereafter, 
or if the victim cache entry 110 was invalid, the cache manager 180 may return to the idle state 
400. 

f*$ If the data request is a cache invalidate command, the cache manager 180 also may 

generate a TWI UOP 460. The TWI UOP 460 may cause new state information, designating an 
_g. 15 invalid state, to be written to the cache entry 1 10 of a single way. The cache manager 1 80 may 
€l determine the target way from the cache invalidate command itself. All other ways and the 
in victim allocation unit 160 may be powered down during processing of the TWI UOP 460. 
Q Thereafter, the cache manager 1 80 may return to the idle state 400. 

Q If the data request is a snoop probe, the cache manager 180 may generate a Tl UOP 

fll 20 470. The Tl UOP 470 may cause data to be read from the tag fields 120 and state fields S from 
S; addressed cache entries 1 10 in all ways of the cache 100. The data fields 130 throughout the 
Q cache 100 and the victim allocation unit 160 may be powered down during the Tl UOP 370. 
Following the Tl UOP 470, if a way comparator 150 indicates a tag match, the cache manager 
may generate a TWI UOP 480 if the state information from the matching cache entry 110 
25 indicates that the data were held in exclusive state or if the snoop probe were not a Go-to- 
Shared snoop. The TWI UOP 480 may update the data held in the state field S of the matching 
cache entry 110. The tag field 120 and the data field 130 in the matching way may be powered 
down. Further, all other ways and the victim allocation unit 160 may be powered down. 
Thereafter, the cache manager 180 may return to the idle state 400. Following the Tl UOP 470, 
30 if the state information from the matching cache entry 110 indicates that the data is invalid or 
modified, the cache manager 180 may return to the idle state 400. 
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If the data request is a snoop confirm command and no data is to be transferred via an 
implicit writeback, the cache manager 180 may generate a TWI UOP 480. The TWI UOP 480 
may cause data to be written to the state field S from an addressed cache entry 1 10 in a single 
way of the cache 100. The tag field 120 and the data field 130 in the matching way may be 
5 powered down. Further, all other ways and the victim allocation unit 160 may be powered 
down. Thereafter, the cache manager 1 80 may return to the idle state 400. 

If the data request is a snoop confirm command and data is to be transferred via an 
implicit writeback, the cache manager 180 may generate a TWR UOP 490. The TWR UOP 490 
may cause data to be read from a data field 130 and new state data to be written to the state 
1 0 field S in a single way of the cache 1 00. All other ways and the victim allocation unit 1 60 may 
be powered down during processing of the TWR UOP 490. Thereafter, the cache manager 180 
may return to the idle state 400. 

JjJ When the data request is a write of data pursuant to an RFO, the cache manager 180 

M may generate a TW UOP 500, causing a write of tag and state information in the tag field 120 
Ji 15 and state field S of a cache entry 1 10 in a single way. All other ways and the victim allocation 
H unit 160 may be powered down during processing of the TW UOP 500. Thereafter, the cache 
pv manager 1 80 may return to the idle state 300. 

M In the foregoing embodiments, the cache manager 180 may generate an RLU UOP in 

p5 response to a read request. The RLU UOP, as described, may cause cache entries 110 from 

68 20 all ways to be energized in their entirety - the tag field 120, the data field 130 and the state field 
S -- in addition to the LRU 170 in the victim allocation unit 160. This permits a parallel read of 
all data fields 130 in the cache. If a comparator 150 and state data S indicates a tag match, the 
contents of the data field 130 of the matching way may be used without delay. Although the 
parallel read of data from all ways provides a very fast way of accessing requested data, it 
25 consumes unnecessary power. 

FIG. 4 is a state diagram illustrating response to a read request in accordance with an 
embodiment of the present invention. In this embodiment, a cache manager may advance from 
an idle state 600 and issue a Tl UOP 610 in response to the read request. As noted, a Tl UOP 
610 may cause data to be read from the tag fields 120 and state fields S of all ways in the cache 
30 1 00. The data fields 1 30 may be powered down during the Tl UOP 61 0. From the tag and state 
data, a determination may be made whether the request hit the cache. 
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If the request hit the cache 100, the cache manager may generate a data read UOP 
("DR") 620 causing data to be read from a data field 130 in the one way that generate the tag 
match. During the DR UOP 620, the tag field 120 and state field S of the matching way may be 
powered down. Also, all other ways may be powered down. The victim allocation unit 160 may 
5 remain powered to be updated. Thereafter, the cache manager 1 80 may return to the idle state. 

If the data request missed the cache, the cache manager 180 may generate an "LRU 
Read" UOP 630 causing data to be read from the victim allocation unit 160. All ways may be 
powered down during the LRU Read UOP 630. The victim allocation unit 160 may identify a 
victim way. From the state information read in the Tl UOP 610, the cache manager 180 may 
10 determine whether the victim data is dirty or not dirty. If the victim data is dirty, the cache 
manager may generate an Evict UOP 640. The Evict UOP 640 may occur as in prior 
embodiments. Thereafter, or if the victim data was not dirty, the cache manager 180 may return 
p to the idle state. 

% 4 The embodiment of FIG. 4 benefits from reduced power consumption for read requests 

Jj 15 than in prior embodiments but at the cost of a slightly increased latency for read request. In the 
H prior embodiments operating in accordance with an RLU UOP, reading data fields 130 from 
cache entries 1 10 that did not have a tag match wastes power. By contrast, the embodiment of 
s FIG. 4 reads data from a data field 1 30 only after a tag match identifies a way that may store the 

j*H requested data. Data is not read from the other ways. 

EG; 20 Block diagrams of caches, such as the diagram of FIG. 1, are useful to understand the 

logical structure and operation of a cache. While such diagrams accurately describe the logical 
structure of a cache, they do not describe a cache at the circuit level. As is known, when the 
circuits of a cache are fabricated in an integrated circuit, memory cells of the various ways often 
are inter-mixed spatially and organized into banks to conserve area in the integrated circuit. To 

25 conserve power, embodiments of the present invention provide an alternate organization 
scheme for cache layouts. FIG. 5 is a block diagram illustrating cache organization according to 
conventional techniques. Although the dimension of a cache 700 may vary in the number of 
sets, ways and the size of cache entries, for illustrative purposes, the cache of FIG. 5 is shown 
as having 1024 sets, eight ways and cache entries having 256 bits. The cache is also shown 

30 organized into eight different banks. Address decoders 710, 720 may select one of the sets in 
response to an input address signal. In FIG. 5, although two address decoders are shown, only 
one of the sets 0-1023 will be selected in response to an address signal. Addressed data may 
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propagate from the banks to a set of latches 730-760. From the latches 730-760, the data may 
be read out from the cache 700. 



As is known, within a set, memory cells from each of the ways 0-7 may be co-located. 
Thus, memory cells associated with the most significant bit from each of the eight ways may be 
5 provided in a cluster (shown as B255) in the integrated circuit layout. Memory cells associated 
with a next most significant bit may be provided in a second cluster B 254 . This architecture may 
repeat for each bit position concluding with a cluster of memory cells for the least significant bit 
position B 0 in the cache. The architecture may span across multiple banks in the cache 700. 
Thus, for set 1023, clusters B 255 -Bo are shown extending across banks 0, 2, 4 and 6. Every 
10 bank 0-7, however, stores data from each of the ways. As noted, this architecture conserves 
area in an integrated circuit. 

In a conventional cache, when operating upon a target way in the cache, an address 
*J2 decoder must drive a selection signal with sufficient energy to power not only the one target way 
H (say, way 0), but also all other ways in the cache 700. The memory cells are provided in 
X 15 clusters B 2 55-B 0 . No prior technique permitted an address decoder to select only a portion of a 
M cluster B 2 55- 

^ FIG. 6 is a block diagram illustrating cache organization according to an embodiment of 

M* the present invention. For illustrative purposes, the cache 800 is shown as having the same 

Us 

^ dimension as the cache of FIG. 5 -1024 sets, eight ways and cache entries having 256 bits. In 
ill 20 this embodiment, a cache 800 also may be populated by a number of banks. Sixteen banks are 
5{ shown in the example of FIG. 6. In this example, however, cache entries may be distributed 

throughout the banks in a manner consistent with the power conservation techniques described 

above. 

According to an embodiment, each bank 0-1 6 may store data from less than the total 
25 number of ways in the cache. For example, as shown in FIG. 6, data from only two ways 0-1 are 
shown as stored in banks 0, 4, 8 and 12. Each bank may include clusters of memory cells from 
respective sets of each of the ways associated with the respective bank. Thus, bank 12 is 
shown as having clusters B' 2 55-B'o each of which would include two memory cells, one from a 
respective bit position in way 0 and another from a respective bit position in way 1. Bank 13 
30 may have a similar structure. Each cluster B'WB'o may include two memory cells, one from a 
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respective bit position in way 2 and another from a respective bit position in way 3. The 
structure may be repeated throughout the remaining banks in the cache. 

Each bank also may be driven by a respective bank select signal. When disabled, it 
prevents the respective bank from responding to address signals from the address decoders. 
5 The clusters BWB'O and B" 2 55-B" 0 each are one fourth the size of corresponding clusters B255- 
B 0 in FIG. 5. Thus, the architecture of the present invention permits the address decoders to 
generate set selection signals with less power when compared with, for example, the cache of 
FIG. 5. 

As may be appreciated, the structure of FIG. 6 conserves power but at the cost of 
10 additional area on the integrated circuit. In FIG. 5, when data is read from an addressed bank, 
only 256 data lines are required to read data from the eight ways. By contrast, in FIG. 6, the 
number of data lines associated with the eight ways increase by a factor of 4. Further, 
additional control logic, such as the bank select signals, may be provided to implement the 
control functions described herein. 




The principles of the present invention, of course, are not limited to the example shown 



UT in FIG. 6. Instead of having two ways provided in each bank (e.g. ways 0-1 for bank 12), it is 

^ permissible to have a single way provided in each bank or, alternatively, any number of ways 

M": provided per bank up to one-half the total number of ways in the cache. Each implementation 

yt achieves a different amount of power conservation. In practice, however, power conservation is 

SB; 20 but one design objective which will be balanced by competing objectives to conserve circuit 

Jjirj; area and to maintain simplicity in design. 

Several embodiments of the present invention are specifically illustrated and described 
herein. However, it will be appreciated that modifications and variations of the present invention 
are covered by the above teachings and within the purview of the appended claims without 
25 departing from the spirit and intended scope of the invention. 
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